High-density energy directing devices for two-dimensional, stereoscopic, light field and holographic head-mounted displays

ABSTRACT

Disclosed are high-density energy directing devices and systems thereof for two-dimensional, stereoscopic, light field and holographic head-mounted displays. In general, the head-mounted display system includes one or more energy devices and one or more energy relay elements, each energy relay element having a first surface and a second surface. The first surface is disposed in energy propagation paths of the one or more energy devices and the second surface of each of the one or more energy relay elements is arranged to form a singular seamless energy surface. A separation between edges of any two adjacent second surfaces is less than a minimum perceptible contour as defined by the visual acuity of a human eye having better than 20/40 vision at a distance from the singular seamless energy surface, the distance being greater than the lesser of: half of a height of the singular seamless energy surface, or half of a width of the singular seamless energy surface.

TECHNICAL FIELD

This disclosure generally relates to head-mounted displays, and morespecifically, to high-density energy directing devices fortwo-dimensional, stereoscopic, light field and holographic head-mounteddisplays.

BACKGROUND

The dream of an interactive virtual world within a “holodeck” chamber aspopularized by Gene Roddenberry's Star Trek and originally envisioned byauthor Alexander Moszkowski in the early 1900s has been the inspirationfor science fiction and technological innovation for nearly a century.However, no compelling implementation of this experience exists outsideof literature, media, and the collective imagination of children andadults alike.

SUMMARY

Disclosed are high-density energy directing devices and systems thereoffor two-dimensional, stereoscopic, light field and holographichead-mounted displays.

In one embodiment, a head-mounted display system includes: one or moreenergy devices; one or more energy relay elements, each having a firstsurface and a second surface, where the first surface is disposed inenergy propagation paths of the one or more energy devices; where thesecond surface of each of the one or more energy relay elements isarranged to form a singular seamless energy surface; where a separationbetween edges of any two adjacent second surfaces is less than a minimumperceptible contour as defined by the visual acuity of a human eyehaving better than 20/40 vision at a distance from the singular seamlessenergy surface, the distance being greater than the lesser of: half of aheight of the singular seamless energy surface, or half of a width ofthe singular seamless energy surface; where a first aperture has a firstfield of view on the singular seamless energy surface, and a secondaperture has a second field of view on the singular seamless energysurface, the first and second fields of view overlapping in a firstregion; and an energy inhibiting element configured to substantiallyallows energy to propagate through only one of the first and secondapertures.

In one embodiment, each of the one or more energy relay elementsincludes a flexible waveguide configured to provide magnified optics orminified optics. In some embodiments, each of the second surfaces of theone or more energy relay elements can be flat, curved, faceted, ornon-uniform.

In another embodiment, the one or more energy devices include a firstenergy device and a second energy device, where both of the first energydevice and the second energy device include displays, and where thesystem further comprises an energy combining element configured to relayenergy between each of the first energy device and the second energydevice, and the first surface of the energy relay element.

In another embodiment, the one or more energy devices include a firstenergy device and a second energy device, where both of the first energydevice and the second energy device include energy sensing devices, andwhere the system further comprises an energy combining elementconfigured to relay energy between each of the first energy device andthe second energy device, and the first surface of the energy relayelement.

In another embodiment, the one or more energy devices include a firstenergy device and a second energy device, where the first energy deviceincludes a display and the second energy device include an energysensing device, and where the system further comprises an energycombining element configured to relay energy between each of the firstenergy device and the second energy device, and the first surface of theenergy relay element.

In one embodiment, the system further includes an additional waveguideelement configured to substantially alter the direction of energy topropagate through the first aperture, the second aperture, or both thefirst and second apertures.

In some embodiments, the additional waveguide element includes adioptric adjustment optics that increases the first field of view, thesecond field of view, or both the first and second fields of view.

In one embodiment, the system further includes an energy combiningelement having first and second input surfaces, the first input surfacedisposed in energy propagation paths of the single seamless energysurface and the second input surface disposed in energy propagationpaths of an additional energy source.

In some embodiments, the energy combining element is configured tocombine energy propagating through the first and second input surfacesand output the combined energy through an output surface of the energycombining element.

In other embodiments, the energy combining element can be a polarizingbeam splitter, a prism or a dichoric film.

In some embodiments, the additional energy source includes at least oneof a portion of ambient energy, energy from the one or more energydevices, energy from non-energy devices, and energy outside of thesystem.

In one embodiment, each of the one or more energy relay elementsincludes first and second structures, the first structure having a firstrefractive index and a first engineered property, the second structurehaving a second refractive index and a second engineered property, andwhere each of the one or more energy relay elements includes randomizedrefractive index variability of the first refractive index and thesecond refractive index, and randomized engineering properties of thefirst engineered property and the second engineered property such thatenergy propagating therethrough have higher transport efficiency in alongitudinal orientation versus a transverse orientation due to therandomized refractive index variability and the randomized engineeringproperties.

In one embodiment, a head-mounted display system includes: an energyassembly having at least one energy device; and a relay assembly having:at least one energy relay element, the energy relay element having firstand second structures, the first structure having a first refractiveindex and a first engineered property, the second structure having asecond refractive index and a second engineered property, the energyrelay element having randomized refractive index variability of thefirst refractive index and the second refractive index, and randomizedengineering properties of the first engineered property and the secondengineered property such that energy propagating therethrough havehigher transport efficiency in a longitudinal orientation versus atransverse orientation due to the randomized refractive indexvariability and the randomized engineering properties; and where theenergy relay element is configured to direct energy along energypropagation paths between a surface of the energy relay element and theenergy device.

In another embodiment, the energy relay element includes a flexiblewaveguide configured to provide magnified optics or minified optics. Insome embodiments, the energy relay element can be flat, curved, faceted,or non-uniform. In other embodiments, the energy assembly includes afirst energy device and a second energy device spaced from each other,the relay assembly includes a first energy relay element and a secondenergy relay element spaced from each other, where the first energyrelay element is configured to direct energy along a first energypropagation path between a first surface of the first energy relayelement and the first energy device, and where the second energy relayelement is configured to direct energy along a second energy propagationpath between a first surface of the second energy relay element and thesecond energy device.

In one embodiment, both of the first energy device and the second energydevice include displays, and where the system further comprises anenergy combining element configured to relay energy between the firstsurface of the first energy relay element and the first energy device,and the first surface of the second energy relay element and the secondenergy device.

In another embodiment, both of the first energy device and the secondenergy device include energy sensing devices, and where the systemfurther comprises an energy combining element configured to relay energybetween the first surface of the first energy relay element and thefirst energy device, and the first surface of the second energy relayelement and the second energy device.

In yet another embodiment the first energy device includes a display andthe second energy device includes an energy sensing device, and wherethe system further comprises an energy combining element configured torelay energy between the first surface of the first energy relay elementand the first energy device, and the first surface of the second energyrelay element and the second energy device.

In one embodiment, the system further includes an additional waveguideelement configured to substantially alter the direction of energy alongan alternate energy propagation path.

In another embodiment, the additional waveguide element includes adioptric adjustment optic that increases a field of view of the energyalong the energy propagation path.

In another embodiment, the system further includes an energy combiningelement having first and second input surfaces, the first input surfacedisposed in the energy propagation path between the surface of theenergy relay element and the energy device, and the second input surfacedisposed in additional energy propagation path of an additional energysource.

In one embodiment, the energy combining element is configured to combineenergy propagating through the first and second input surfaces andoutput the combined energy through an output surface of the energycombining element.

In another embodiment, the energy combining element can be a polarizingbeam splitter, a prism or a dichoric film.

In some embodiments, the additional energy source includes at least aportion of ambient energy, energy from the at least one energy device,energy from non-energy devices, and energy outside of the system.

In one embodiment, a head-mounted display system includes: one or moreenergy devices; one or more energy relay elements, each having a firstsurface and a second surface, where the first surface is disposed inenergy propagation paths of the one or more energy devices; where thesecond surface of each of the one or more energy relay elements isarranged to form a singular seamless energy surface; where a separationbetween edges of any two adjacent second surfaces is less than a minimumperceptible contour as defined by the visual acuity of a human eyehaving better than 20/40 vision at a distance from the singular seamlessenergy surface, the distance being greater than the lesser of: half of aheight of the singular seamless energy surface, or half of a width ofthe singular seamless energy surface; where a first aperture has a firstfield of view on the singular seamless energy surface, and a secondaperture has a second field of view on the singular seamless energysurface, the first and second fields of view overlapping in a firstregion. In this embodiment, the system also includes an energyinhibiting element configured to substantially allow energy to propagatethrough only one of the first and second apertures; and an energycombining element having first and second input surfaces, the firstinput surface disposed in the energy propagation paths of the singleseamless energy surface and the second input surface disposed in energypropagation paths of an additional energy source.

In another embodiment, each of the one or more energy relay elementsincludes a flexible waveguide configured to provide magnified optics orminified optics.

In another embodiment, each of the second surfaces of the one or moreenergy relay elements can be flat, curved, faceted, or non-uniform.

In some embodiments, the one or more energy devices include a firstenergy device and a second energy device, where both of the first energydevice and the second energy device include displays, and where thesystem further comprises an energy combining element configured to relayenergy between each of the first energy device and the second energydevice, and the first surface of the energy relay element.

In other embodiments, the one or more energy devices include a firstenergy device and a second energy device, where both of the first energydevice and the second energy device include energy sensing devices, andwhere the system further comprises an energy combining elementconfigured to relay energy between each of the first energy device andthe second energy device, and the first surface of the energy relayelement.

In some embodiments, the one or more energy devices include a firstenergy device and a second energy device, where the first energy deviceincludes a display and the second energy device include an energysensing device, and where the system further comprises an energycombining element configured to relay energy between each of the firstenergy device and the second energy device, and the first surface of theenergy relay element.

In one embodiment, the system further includes an additional waveguideelement configured to substantially alter the direction of energy topropagate through the first aperture, the second aperture, or both thefirst and second apertures.

In some embodiments, the additional waveguide element includes adioptric adjustment optics that increases the first field of view, thesecond field of view, or both the first and second fields of view.

In one embodiment, the energy combining element is configured to combineenergy propagating through the first and second input surfaces andoutput the combined energy through an output surface of the energycombining element.

In some embodiments, the energy combining element can be a polarizingbeam splitter, a prism or a dichoric film.

In other embodiments, the additional energy source includes at least oneof a portion of ambient energy, energy from the one or more energydevices, energy from non-energy devices, and energy outside of thesystem.

In some embodiments, each of the one or more energy relay elementsincludes first and second structures, the first structure having a firstrefractive index and a first engineered property, the second structurehaving a second refractive index and a second engineered property, andwhere each of the one or more energy relay elements includes randomizedrefractive index variability of the first refractive index and thesecond refractive index, and randomized engineering properties of thefirst engineered property and the second engineered property such thatenergy propagating therethrough have higher transport efficiency in alongitudinal orientation versus a transverse orientation due to therandomized refractive index variability and the randomized engineeringproperties.

In one embodiment, the system further includes an array of energywaveguides configured to direct energy therethrough along the energypropagation paths, where the energy waveguides of the array are locatedat different spatial coordinates, and each energy waveguide directsenergy from the respective spatial coordinate to the energy propagationpaths along different directions according to a 4D plenoptic function.

In another embodiment, the system further includes an energy modulationelement disposed between the energy combining element and the singleseamless energy surface, the energy modulation element configured tomodulate energy passing therethrough.

These and other advantages of the present disclosure will becomeapparent to those skilled in the art from the following detaileddescription and the appended claims.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram illustrating design parameters for anenergy directing system;

FIG. 2 is a schematic diagram illustrating an energy system having anactive device area with a mechanical envelope;

FIG. 3 is a schematic diagram illustrating an energy relay system;

FIG. 4 is a schematic diagram illustrating an embodiment of energy relayelements adhered together and fastened to a base structure;

FIG. 5A is a schematic diagram illustrating an example of a relayedimage through multi-core optical fibers;

FIG. 5B is a schematic diagram illustrating an example of a relayedimage through an optical relay that exhibits the properties of theTransverse Anderson Localization principle;

FIG. 6 is a schematic diagram showing rays propagated from an energysurface to a viewer;

FIG. 7 illustrates an embodiment of two displays that exceed the fieldof view (FOV) of the viewer and provides higher resolution than possiblewith other contemporary technologies, in accordance with one embodimentof the present disclosure;

FIG. 8 illustrates a system having an energy assembly having at leastone energy device, in accordance with one embodiment of the presentdisclosure;

FIG. 9 illustrates a system having an energy assembly having a pluralityof energy devices and a relay element, in accordance with one embodimentof the present disclosure;

FIG. 10 illustrates an embodiment of a head-mounted display (HMD)system, in accordance with one embodiment of the present disclosure;

FIG. 11 illustrates an embodiment of a head-mounted display (HMD)system, in accordance with one embodiment of the present disclosure; and

FIG. 12 illustrates an embodiment of a head-mounted display (HMD)system, in accordance with one embodiment of the present disclosure.

DETAILED DESCRIPTION

An embodiment of a Holodeck (collectively called “Holodeck DesignParameters”) provide sufficient energy stimulus to fool the humansensory receptors into believing that received energy impulses within avirtual, social and interactive environment are real, providing: 1)binocular disparity without external accessories, head-mounted eyewear,or other peripherals; 2) accurate motion parallax, occlusion and opacitythroughout a viewing volume simultaneously for any number of viewers; 3)visual focus through synchronous convergence, accommodation and miosisof the eye for all perceived rays of light; and 4) converging energywave propagation of sufficient density and resolution to exceed thehuman sensory “resolution” for vision, hearing, touch, taste, smell,and/or balance.

Based upon conventional technology to date, we are decades, if notcenturies away from a technology capable of providing for all receptivefields in a compelling way as suggested by the Holodeck DesignParameters including the visual, auditory, somatosensory, gustatory,olfactory, and vestibular systems.

In this disclosure, the terms light field and holographic may be usedinterchangeably to define the energy propagation for stimulation of anysensory receptor response. While initial disclosures may refer toexamples of energy and mechanical energy propagation through energysurfaces for holographic imagery and volumetric haptics, all forms ofsensory receptors are envisioned in this disclosure. Furthermore, theprinciples disclosed herein for energy propagation along propagationpaths may be applicable to both energy emission and energy capture.

Many technologies exist today that are often unfortunately confused withholograms including lenticular printing, Pepper's Ghost, glasses-freestereoscopic displays, horizontal parallax displays, head-mounted VR andAR displays (HMD), and other such illusions generalized as“fauxlography.” These technologies may exhibit some of the desiredproperties of a true holographic display, however, lack the ability tostimulate the human visual sensory response in any way sufficient toaddress at least two of the four identified Holodeck Design Parameters.

These challenges have not been successfully implemented by conventionaltechnology to produce a seamless energy surface sufficient forholographic energy propagation. There are various approaches toimplementing volumetric and direction multiplexed light field displaysincluding parallax barriers, hogels, voxels, diffractive optics,multi-view projection, holographic diffusers, rotational mirrors,multilayered displays, time sequential displays, head mounted display,etc., however, conventional approaches may involve a compromise on imagequality, resolution, angular sampling density, size, cost, safety, framerate, etc., ultimately resulting in an unviable technology.

To achieve the Holodeck Design Parameters for the visual, auditory,somatosensory systems, the human acuity of each of the respectivesystems is studied and understood to propagate energy waves tosufficiently fool the human sensory receptors. The visual system iscapable of resolving to approximately 1 arc min, the auditory system maydistinguish the difference in placement as little as three degrees, andthe somatosensory system at the hands are capable of discerning pointsseparated by 2-12 mm. While there are various and conflicting ways tomeasure these acuities, these values are sufficient to understand thesystems and methods to stimulate perception of energy propagation.

Of the noted sensory receptors, the human visual system is by far themost sensitive given that even a single photon can induce sensation. Forthis reason, much of this introduction will focus on visual energy wavepropagation, and vastly lower resolution energy systems coupled within adisclosed energy waveguide surface may converge appropriate signals toinduce holographic sensory perception. Unless otherwise noted, alldisclosures apply to all energy and sensory domains.

When calculating for effective design parameters of the energypropagation for the visual system given a viewing volume and viewingdistance, a desired energy surface may be designed to include manygigapixels of effective energy location density. For wide viewingvolumes, or near field viewing, the design parameters of a desiredenergy surface may include hundreds of gigapixels or more of effectiveenergy location density. By comparison, a desired energy source may bedesigned to have 1 to 250 effective megapixels of energy locationdensity for ultrasonic propagation of volumetric haptics or an array of36 to 3,600 effective energy locations for acoustic propagation ofholographic sound depending on input environmental variables. What isimportant to note is that with a disclosed bi-directional energy surfacearchitecture, all components may be configured to form the appropriatestructures for any energy domain to enable holographic propagation.

However, the main challenge to enable the Holodeck today involvesavailable visual technologies and energy device limitations. Acousticand ultrasonic devices are less challenging given the orders ofmagnitude difference in desired density based upon sensory acuity in therespective receptive field, although the complexity should not beunderestimated. While holographic emulsion exists with resolutionsexceeding the desired density to encode interference patterns in staticimagery, state-of-the-art display devices are limited by resolution,data throughput and manufacturing feasibility. To date, no singulardisplay device has been able to meaningfully produce a light fieldhaving near holographic resolution for visual acuity.

Production of a single silicon-based device capable of meeting thedesired resolution for a compelling light field display may not bepractical and may involve extremely complex fabrication processes beyondthe current manufacturing capabilities. The limitation to tilingmultiple existing display devices together involves the seams and gapformed by the physical size of packaging, electronics, enclosure, opticsand a number of other challenges that inevitably result in an unviabletechnology from an imaging, cost and/or a size standpoint.

The embodiments disclosed herein may provide a real-world path tobuilding the Holodeck.

Example embodiments will now be described hereinafter with reference tothe accompanying drawings, which form a part hereof, and whichillustrate example embodiments which may be practiced. As used in thedisclosures and the appended claims, the terms “embodiment”, “exampleembodiment”, and “exemplary embodiment” do not necessarily refer to asingle embodiment, although they may, and various example embodimentsmay be readily combined and interchanged, without departing from thescope or spirit of example embodiments. Furthermore, the terminology asused herein is for the purpose of describing example embodiments onlyand is not intended to be limitations. In this respect, as used herein,the term “in” may include “in” and “on”, and the terms “a,” “an” and“the” may include singular and plural references. Furthermore, as usedherein, the term “by” may also mean “from”, depending on the context.Furthermore, as used herein, the term “if” may also mean “when” or“upon,” depending on the context. Furthermore, as used herein, the words“and/or” may refer to and encompass any and all possible combinations ofone or more of the associated listed items.

Holographic System Considerations Overview of Light Field EnergyPropagation Resolution

Light field and holographic display is the result of a plurality ofprojections where energy surface locations provide angular, color andintensity information propagated within a viewing volume. The disclosedenergy surface provides opportunities for additional information tocoexist and propagate through the same surface to induce other sensorysystem responses. Unlike a stereoscopic display, the viewed position ofthe converged energy propagation paths in space do not vary as theviewer moves around the viewing volume and any number of viewers maysimultaneously see propagated objects in real-world space as if it wastruly there. In some embodiments, the propagation of energy may belocated in the same energy propagation path but in opposite directions.For example, energy emission and energy capture along an energypropagation path are both possible in some embodiments of the presentdisclosed.

FIG. 1 is a schematic diagram illustrating variables relevant forstimulation of sensory receptor response. These variables may includesurface diagonal 101, surface width 102, surface height 103, adetermined target seating distance 118, the target seating field of viewfield of view from the center of the display 104, the number ofintermediate samples demonstrated here as samples between the eyes 105,the average adult inter-ocular separation 106, the average resolution ofthe human eye in arcmin 107, the horizontal field of view formed betweenthe target viewer location and the surface width 108, the vertical fieldof view formed between the target viewer location and the surface height109, the resultant horizontal waveguide element resolution, or totalnumber of elements, across the surface 110, the resultant verticalwaveguide element resolution, or total number of elements, across thesurface 111, the sample distance based upon the inter-ocular spacingbetween the eyes and the number of intermediate samples for angularprojection between the eyes 112, the angular sampling may be based uponthe sample distance and the target seating distance 113, the totalresolution Horizontal per waveguide element derived from the angularsampling desired 114, the total resolution Vertical per waveguideelement derived from the angular sampling desired 115, device Horizontalis the count of the determined number of discreet energy sources desired116, and device Vertical is the count of the determined number ofdiscreet energy sources desired 117.

A method to understand the desired minimum resolution may be based uponthe following criteria to ensure sufficient stimulation of visual (orother) sensory receptor response: surface size (e.g., 84″ diagonal),surface aspect ratio (e.g., 16:9), seating distance (e.g., 128″ from thedisplay), seating field of view (e.g., 120 degrees or +/−60 degreesabout the center of the display), desired intermediate samples at adistance (e.g., one additional propagation path between the eyes), theaverage inter-ocular separation of an adult (approximately 65 mm), andthe average resolution of the human eye (approximately 1 arcmin). Theseexample values should be considered placeholders depending on thespecific application design parameters.

Further, each of the values attributed to the visual sensory receptorsmay be replaced with other systems to determine desired propagation pathparameters. For other energy propagation embodiments, one may considerthe auditory system's angular sensitivity as low as three degrees, andthe somatosensory system's spatial resolution of the hands as small as2-12 mm.

While there are various and conflicting ways to measure these sensoryacuities, these values are sufficient to understand the systems andmethods to stimulate perception of virtual energy propagation. There aremany ways to consider the design resolution, and the below proposedmethodology combines pragmatic product considerations with thebiological resolving limits of the sensory systems. As will beappreciated by one of ordinary skill in the art, the following overviewis a simplification of any such system design, and should be consideredfor exemplary purposes only.

With the resolution limit of the sensory system understood, the totalenergy waveguide element density may be calculated such that thereceiving sensory system cannot discern a single energy waveguideelement from an adjacent element, given:

${\bullet\mspace{11mu}{Surface}\mspace{14mu}{Aspect}\mspace{14mu}{Ratio}} = \frac{{Width}(W)}{{Height}(H)}$${\bullet\mspace{11mu}{Surface}\mspace{14mu}{Horizontal}\mspace{14mu}{Size}} = {{Surface}\mspace{14mu}{Diagonal}*( \frac{1}{\sqrt{( {1 + ( \frac{H}{W} )^{2}} }} )}$${\bullet\mspace{11mu}{Surface}\mspace{14mu}{Vertical}\mspace{14mu}{Size}} = {{Surface}\mspace{14mu}{Diagonal}\;*( \frac{1}{\sqrt{( {1 + ( \frac{W}{H} )^{2}} }} )}$${\bullet\mspace{11mu}{Horzontal}\mspace{14mu}{Field}\mspace{14mu}{of}\mspace{14mu}{View}} = {2*{atan}\;( \frac{{Surface}\mspace{14mu}{Horizontal}\mspace{14mu}{Size}}{2*{Seating}\mspace{14mu}{Distance}} )}$${\bullet\mspace{11mu}{Vertical}\mspace{14mu}{Field}\mspace{14mu}{of}\mspace{14mu}{View}} = {2*{atan}\;( \frac{{Surface}\mspace{14mu}{Verticle}\mspace{14mu}{Size}}{2*{Seating}\mspace{14mu}{Distance}} )}$${\bullet\mspace{11mu}{Horizontal}\mspace{14mu}{Element}\mspace{14mu}{Resolution}} = {{Horizontal}\mspace{14mu}{FoV}*\frac{60}{{Eye}\mspace{14mu}{Resolution}}}$${\bullet\mspace{11mu}{Vertical}\mspace{14mu}{Element}\mspace{14mu}{Resolution}} = {{Vertical}\mspace{14mu}{FoV}*\frac{60}{{Eye}\mspace{14mu}{Resolution}}}$

The above calculations result in approximately a 32×18° field of viewresulting in approximately 1920×1080 (rounded to nearest format) energywaveguide elements being desired. One may also constrain the variablessuch that the field of view is consistent for both (u, v) to provide amore regular spatial sampling of energy locations (e.g. pixel aspectratio). The angular sampling of the system assumes a defined targetviewing volume location and additional propagated energy paths betweentwo points at the optimized distance, given:

${\bullet\mspace{11mu}{Sample}\mspace{14mu}{Distance}} = \frac{{Inter} - {{Ocular}\mspace{14mu}{Distance}}}{( {{{Number}\mspace{14mu}{of}\mspace{14mu}{Desired}\mspace{14mu}{Intermediate}\mspace{14mu}{Samples}} + 1} )}$${\bullet\mspace{11mu}{Angular}\mspace{14mu}{Sampling}} = {{atan}\;( \frac{{Sample}\mspace{14mu}{Distance}}{{Seating}\mspace{14mu}{Distance}} )}$

In this case, the inter-ocular distance is leveraged to calculate thesample distance although any metric may be leveraged to account forappropriate number of samples as a given distance. With the abovevariables considered, approximately one ray per 0.57° may be desired andthe total system resolution per independent sensory system may bedetermined, given:

${\bullet\mspace{11mu}{Locations}\mspace{14mu}{Per}\mspace{14mu}{Element}\;(N)} = \frac{{Seating}\mspace{14mu}{FoV}}{{Angular}\mspace{14mu}{Sampling}}$•  Total  Resolution  H = N * Horizontal  Element  Resolution•  Total  Resolution  V = N * Vertical  Element  Resolution

With the above scenario given the size of energy surface and the angularresolution addressed for the visual acuity system, the resultant energysurface may desirably include approximately 400 k×225 k pixels of energyresolution locations, or 90 gigapixels holographic propagation density.These variables provided are for exemplary purposes only and many othersensory and energy metrology considerations should be considered for theoptimization of holographic propagation of energy. In an additionalembodiment, 1 gigapixel of energy resolution locations may be desiredbased upon the input variables. In an additional embodiment, 1,000gigapixels of energy resolution locations may be desired based upon theinput variables.

Current Technology Limitations Active Area, Device Electronics,Packaging, and the Mechanical Envelope

FIG. 2 illustrates a device 200 having an active area 220 with a certainmechanical form factor. The device 200 may include drivers 230 andelectronics 240 for powering and interface to the active area 220, theactive area having a dimension as shown by the x and y arrows. Thisdevice 200 does not take into account the cabling and mechanicalstructures to drive, power and cool components, and the mechanicalfootprint may be further minimized by introducing a flex cable into thedevice 200. The minimum footprint for such a device 200 may also bereferred to as a mechanical envelope 210 having a dimension as shown bythe M:x and M:y arrows. This device 200 is for illustration purposesonly and custom electronics designs may further decrease the mechanicalenvelope overhead, but in almost all cases may not be the exact size ofthe active area of the device. In an embodiment, this device 200illustrates the dependency of electronics as it relates to active imagearea 220 for a micro OLED, DLP chip or LCD panel, or any othertechnology with the purpose of image illumination.

In some embodiments, it may also be possible to consider otherprojection technologies to aggregate multiple images onto a largeroverall display. However, this may come at the cost of greatercomplexity for throw distance, minimum focus, optical quality, uniformfield resolution, chromatic aberration, thermal properties, calibration,alignment, additional size or form factor. For most practicalapplications, hosting tens or hundreds of these projection sources 200may result in a design that is much larger with less reliability.

For exemplary purposes only, assuming energy devices with an energylocation density of 3840×2160 sites, one may determine the number ofindividual energy devices (e.g., device 100) desired for an energysurface, given:

${\bullet\mspace{11mu}{Devices}\mspace{14mu} H} = \frac{{Total}\mspace{14mu}{Resolution}\mspace{14mu} H}{{Device}\mspace{14mu}{Resolution}\mspace{14mu} H}$${\bullet\mspace{11mu}{Devices}\mspace{14mu} V} = \frac{{Total}\mspace{14mu}{Resolution}\mspace{14mu} V}{{Device}\mspace{14mu}{Resolution}\mspace{14mu} V}$

Given the above resolution considerations, approximately 105×105 devicessimilar to those shown in FIG. 2 may be desired. It should be noted thatmany devices consist of various pixel structures that may or may not mapto a regular grid. In the event that there are additional sub-pixels orlocations within each full pixel, these may be exploited to generateadditional resolution or angular density. Additional signal processingmay be used to determine how to convert the light field into the correct(u,v) coordinates depending on the specified location of the pixelstructure(s) and can be an explicit characteristic of each device thatis known and calibrated. Further, other energy domains may involve adifferent handling of these ratios and device structures, and thoseskilled in the art will understand the direct intrinsic relationshipbetween each of the desired frequency domains. This will be shown anddiscussed in more detail in subsequent disclosure.

The resulting calculation may be used to understand how many of theseindividual devices may be desired to produce a full resolution energysurface. In this case, approximately 105×105 or approximately 11,080devices may be desired to achieve the visual acuity threshold. Thechallenge and novelty exists within the fabrication of a seamless energysurface from these available energy locations for sufficient sensoryholographic propagation.

Summary of Seamless Energy Surfaces Configurations and Designs forArrays of Energy Relays

In some embodiments, approaches are disclosed to address the challengeof generating high energy location density from an array of individualdevices without seams due to the limitation of mechanical structure forthe devices. In an embodiment, an energy propagating relay system mayallow for an increase the effective size of the active device area tomeet or exceed the mechanical dimensions to configure an array of relaysand form a singular seamless energy surface.

FIG. 3 illustrates an embodiment of such an energy relay system 300. Asshown, the relay system 300 may include a device 310 mounted to amechanical envelope 320, with an energy relay element 330 propagatingenergy from the device 310. The relay element 330 may be configured toprovide the ability to mitigate any gaps 340 that may be produced whenmultiple mechanical envelopes 320 of the device are placed into an arrayof multiple devices 310.

For example, if a device's active area 310 is 20 mm×10 mm and themechanical envelope 320 is 40 mm×20 mm, an energy relay element 330 maybe designed with a magnification of 2:1 to produce a tapered form thatis approximately 20 mm×10 mm on a minified end (arrow A) and 40 mm×20 mmon a magnified end (arrow B), providing the ability to align an array ofthese elements 330 together seamlessly without altering or collidingwith the mechanical envelope 320 of each device 310. Mechanically, therelay elements 330 may be bonded or fused together to align and polishensuring minimal seam gap 340 between devices 310. In one suchembodiment, it is possible to achieve a seam gap 340 smaller than thevisual acuity limit of the eye.

FIG. 4 illustrates an example of a base structure 400 having energyrelay elements 410 formed together and securely fastened to anadditional mechanical structure 430. The mechanical structure of theseamless energy surface 420 provides the ability to couple multipleenergy relay elements 410, 450 in series to the same base structurethrough bonding or other mechanical processes to mount relay elements410, 450. In some embodiments, each relay element 410 may be fused,bonded, adhered, pressure fit, aligned or otherwise attached together toform the resultant seamless energy surface 420. In some embodiments, adevice 480 may be mounted to the rear of the relay element 410 andaligned passively or actively to ensure appropriate energy locationalignment within the determined tolerance is maintained.

In an embodiment, the seamless energy surface comprises one or moreenergy locations and one or more energy relay element stacks comprise afirst and second side and each energy relay element stack is arranged toform a singular seamless energy surface directing energy alongpropagation paths extending between one or more energy locations and theseamless energy surface, and where the separation between the edges ofany two adjacent second sides of the terminal energy relay elements isless than the minimum perceptible contour as defined by the visualacuity of a human eye having better than 20/40 vision at a distancegreater than the width of the singular seamless energy surface.

In an embodiment, each of the seamless energy surfaces comprise one ormore energy relay elements each with one or more structures forming afirst and second surface with a transverse and longitudinal orientation.The first relay surface has an area different than the second resultingin positive or negative magnification and configured with explicitsurface contours for both the first and second surfaces passing energythrough the second relay surface to substantially fill a +/−10 degreeangle with respect to the normal of the surface contour across theentire second relay surface.

In an embodiment, multiple energy domains may be configured within asingle, or between multiple energy relays to direct one or more sensoryholographic energy propagation paths including visual, acoustic, tactileor other energy domains.

In an embodiment, the seamless energy surface is configured with energyrelays that comprise two or more first sides for each second side toboth receive and emit one or more energy domains simultaneously toprovide bi-directional energy propagation throughout the system.

In an embodiment, the energy relays are provided as loose coherentelements.

Introduction to Component Engineered Structures Disclosed Advances inTransverse Anderson Localization Energy Relays

The properties of energy relays may be significantly optimized accordingto the principles disclosed herein for energy relay elements that induceTransverse Anderson Localization. Transverse Anderson Localization isthe propagation of a ray transported through a transversely disorderedbut longitudinally consistent material.

This implies that the effect of the materials that produce the AndersonLocalization phenomena may be less impacted by total internal reflectionthan by the randomization between multiple-scattering paths where waveinterference can completely limit the propagation in the transverseorientation while continuing in the longitudinal orientation.

Of significant additional benefit is the elimination of the cladding oftraditional multi-core optical fiber materials. The cladding is tofunctionally eliminate the scatter of energy between fibers, butsimultaneously act as a barrier to rays of energy thereby reducingtransmission by at least the core to clad ratio (e.g., a core to cladratio of 70:30 will transmit at best 70% of received energytransmission) and additionally forms a strong pixelated patterning inthe propagated energy.

FIG. 5A illustrates an end view of an example of one such non-AndersonLocalization energy relay 500, wherein an image is relayed throughmulti-core optical fibers where pixilation and fiber noise may beexhibited due to the intrinsic properties of the optical fibers. Withtraditional multi-mode and multi-core optical fibers, relayed images maybe intrinsically pixelated due to the properties of total internalreflection of the discrete array of cores where any cross-talk betweencores will reduce the modulation transfer function and increaseblurring. The resulting imagery produced with traditional multi-coreoptical fiber tends to have a residual fixed noise fiber pattern similarto those shown in FIG. 3.

FIG. 5B, illustrates an example of the same relayed image 550 through anenergy relay comprising materials that exhibit the properties ofTransverse Anderson Localization, where the relayed pattern has agreater density grain structures as compared to the fixed fiber patternfrom FIG. 5A. In an embodiment, relays comprising randomized microscopiccomponent engineered structures induce Transverse Anderson Localizationand transport light more efficiently with higher propagation ofresolvable resolution than commercially available multi-mode glassoptical fibers.

There is significant advantage to the Transverse Anderson Localizationmaterial properties in terms of both cost and weight, where a similaroptical grade glass material, may cost and weigh upwards of 10 to100-fold more than the cost for the same material generated within anembodiment, wherein disclosed systems and methods comprise randomizedmicroscopic component engineered structures demonstrating significantopportunities to improve both cost and quality over other technologiesknown in the art.

In an embodiment, a relay element exhibiting Transverse AndersonLocalization may comprise a plurality of at least two differentcomponent engineered structures in each of three orthogonal planesarranged in a dimensional lattice and the plurality of structures formrandomized distributions of material wave propagation properties in atransverse plane within the dimensional lattice and channels of similarvalues of material wave propagation properties in a longitudinal planewithin the dimensional lattice, wherein localized energy wavespropagating through the energy relay have higher transport efficiency inthe longitudinal orientation versus the transverse orientation.

In an embodiment, multiple energy domains may be configured within asingle, or between multiple Transverse Anderson Localization energyrelays to direct one or more sensory holographic energy propagationpaths including visual, acoustic, tactile or other energy domains.

In an embodiment, the seamless energy surface is configured withTransverse Anderson Localization energy relays that comprise two or morefirst sides for each second side to both receive and emit one or moreenergy domains simultaneously to provide bi-directional energypropagation throughout the system.

In an embodiment, the Transverse Anderson Localization energy relays areconfigured as loose coherent or flexible energy relay elements.

Considerations for 4D Plenoptic Functions Selective Propagation ofEnergy Through Holographic Waveguide Arrays

As discussed above and herein throughout, a light field display systemgenerally includes an energy source (e.g., illumination source) and aseamless energy surface configured with sufficient energy locationdensity as articulated in the above discussion. A plurality of relayelements may be used to relay energy from the energy devices to theseamless energy surface. Once energy has been delivered to the seamlessenergy surface with the requisite energy location density, the energycan be propagated in accordance with a 4D plenoptic function through adisclosed energy waveguide system. As will be appreciated by one ofordinary skill in the art, a 4D plenoptic function is well known in theart and will not be elaborated further herein.

The energy waveguide system selectively propagates energy through aplurality of energy locations along the seamless energy surfacerepresenting the spatial coordinate of the 4D plenoptic function with astructure configured to alter an angular direction of the energy wavespassing through representing the angular component of the 4D plenopticfunction, wherein the energy waves propagated may converge in space inaccordance with a plurality of propagation paths directed by the 4Dplenoptic function.

Reference is now made to FIG. 6 illustrating an example of light fieldenergy surface in 4D image space in accordance with a 4D plenopticfunction. The figure shows ray traces of an energy surface 600 to aviewer 620 in describing how the rays of energy converge in space 630from various positions within the viewing volume. As shown, eachwaveguide element 610 defines four dimensions of information describingenergy propagation 640 through the energy surface 600. Two spatialdimensions (herein referred to as x and y) are the physical plurality ofenergy locations that can be viewed in image space, and the angularcomponents theta and phi (herein referred to as u and v), which isviewed in virtual space when projected through the energy waveguidearray. In general and in accordance with a 4D plenoptic function, theplurality of waveguides (e.g., lenslets) are able to direct an energylocation from the x, y dimension to a unique location in virtual space,along a direction defined by the u, v angular component, in forming theholographic or light field system described herein.

However, one skilled in the art will understand that a significantchallenge to light field and holographic display technologies arisesfrom uncontrolled propagation of energy due designs that have notaccurately accounted for any of diffraction, scatter, diffusion, angulardirection, calibration, focus, collimation, curvature, uniformity,element cross-talk, as well as a multitude of other parameters thatcontribute to decreased effective resolution as well as an inability toaccurately converge energy with sufficient fidelity.

In an embodiment, an approach to selective energy propagation foraddressing challenges associated with holographic display may includeenergy inhibiting elements and substantially filling waveguide apertureswith near-collimated energy into an environment defined by a 4Dplenoptic function.

In an embodiment, an array of energy waveguides may define a pluralityof energy propagation paths for each waveguide element configured toextend through and substantially fill the waveguide element's effectiveaperture in unique directions defined by a prescribed 4D function to aplurality of energy locations along a seamless energy surface inhibitedby one or more elements positioned to limit propagation of each energylocation to only pass through a single waveguide element.

In an embodiment, multiple energy domains may be configured within asingle, or between multiple energy waveguides to direct one or moresensory holographic energy propagations including visual, acoustic,tactile or other energy domains.

In an embodiment, the energy waveguides and seamless energy surface areconfigured to both receive and emit one or more energy domains toprovide bi-directional energy propagation throughout the system.

In an embodiment, the energy waveguides are configured to propagatenon-linear or non-regular distributions of energy, includingnon-transmitting void regions, leveraging digitally encoded,diffractive, refractive, reflective, grin, holographic, Fresnel, or thelike waveguide configurations for any seamless energy surfaceorientation including wall, table, floor, ceiling, room, or othergeometry based environments. In an additional embodiment, an energywaveguide element may be configured to produce various geometries thatprovide any surface profile and/or tabletop viewing allowing users toview holographic imagery from all around the energy surface in a360-degree configuration.

In an embodiment, the energy waveguide array elements may be reflectivesurfaces and the arrangement of the elements may be hexagonal, square,irregular, semi-regular, curved, non-planar, spherical, cylindrical,tilted regular, tilted irregular, spatially varying and/ormulti-layered.

For any component within the seamless energy surface, waveguide, orrelay components may include, but not limited to, optical fiber,silicon, glass, polymer, optical relays, diffractive, holographic,refractive, or reflective elements, optical face plates, energycombiners, beam splitters, prisms, polarization elements, spatial lightmodulators, active pixels, liquid crystal cells, transparent displays,or any similar materials exhibiting Anderson localization or totalinternal reflection.

Realizing the Holodeck Aggregation of Bi-Directional Seamless EnergySurface Systems to Stimulate Human Sensory Receptors within HolographicEnvironments

It is possible to construct large-scale environments of seamless energysurface systems by tiling, fusing, bonding, attaching, and/or stitchingmultiple seamless energy surfaces together forming arbitrary sizes,shapes, contours or form-factors including entire rooms. Each energysurface system may comprise an assembly having a base structure, energysurface, relays, waveguide, devices, and electronics, collectivelyconfigured for bi-directional holographic energy propagation, emission,reflection, or sensing.

In an embodiment, an environment of tiled seamless energy systems areaggregated to form large seamless planar or curved walls includinginstallations comprising up to all surfaces in a given environment, andconfigured as any combination of seamless, discontinuous planar,faceted, curved, cylindrical, spherical, geometric, or non-regulargeometries.

In an embodiment, aggregated tiles of planar surfaces form wall-sizedsystems for theatrical or venue-based holographic entertainment. In anembodiment, aggregated tiles of planar surfaces cover a room with fourto six walls including both ceiling and floor for cave-based holographicinstallations. In an embodiment, aggregated tiles of curved surfacesproduce a cylindrical seamless environment for immersive holographicinstallations. In an embodiment, aggregated tiles of seamless sphericalsurfaces form a holographic dome for immersive Holodeck-basedexperiences.

In an embodiment, aggregates tiles of seamless curved energy waveguidesprovide mechanical edges following the precise pattern along theboundary of energy inhibiting elements within the energy waveguidestructure to bond, align, or fuse the adjacent tiled mechanical edges ofthe adjacent waveguide surfaces, resulting in a modular and seamlessenergy waveguide system.

In a further embodiment of an aggregated tiled environment, energy ispropagated bi-directionally for multiple simultaneous energy domains. Inan additional embodiment, the energy surface provides the ability toboth display and capture simultaneously from the same energy surfacewith waveguides designed such that light field data may be projected byan illumination source through the waveguide and simultaneously receivedthrough the same energy surface. In an additional embodiment, additionaldepth sensing and active scanning technologies may be leveraged to allowfor the interaction between the energy propagation and the viewer incorrect world coordinates. In an additional embodiment, the energysurface and waveguide are operable to emit, reflect or convergefrequencies to induce tactile sensation or volumetric haptic feedback.In some embodiments, any combination of bi-directional energypropagation and aggregated surfaces are possible.

In an embodiment, the system comprises an energy waveguide capable ofbi-directional emission and sensing of energy through the energy surfacewith one or more energy devices independently paired withtwo-or-more-path energy combiners to pair at least two energy devices tothe same portion of the seamless energy surface, or one or more energydevices are secured behind the energy surface, proximate to anadditional component secured to the base structure, or to a location infront and outside of the FOV of the waveguide for off-axis direct orreflective projection or sensing, and the resulting energy surfaceprovides for bi-directional transmission of energy allowing thewaveguide to converge energy, a first device to emit energy and a seconddevice to sense energy, and where the information is processed toperform computer vision related tasks including, but not limited to, 4Dplenoptic eye and retinal tracking or sensing of interference withinpropagated energy patterns, depth estimation, proximity, motiontracking, image, color, or sound formation, or other energy frequencyanalysis. In an additional embodiment, the tracked positions activelycalculate and modify positions of energy based upon the interferencebetween the bi-directional captured data and projection information.

In some embodiments, a plurality of combinations of three energy devicescomprising an ultrasonic sensor, a visible energy display, and anultrasonic emitting device are configured together for each of threefirst relay surfaces propagating energy combined into a single secondenergy relay surface with each of the three first surfaces comprisingengineered properties specific to each device's energy domain, and twoengineered waveguide elements configured for ultrasonic and energyrespectively to provide the ability to direct and converge each device'senergy independently and substantially unaffected by the other waveguideelements that are configured for a separate energy domain.

In some embodiments, disclosed is a calibration procedure to enableefficient manufacturing to remove system artifacts and produce ageometric mapping of the resultant energy surface for use withencoding/decoding technologies as well as dedicated integrated systemsfor the conversion of data into calibrated information appropriate forenergy propagation based upon the calibrated configuration files.

In some embodiments, additional energy waveguides in series and one ormore energy devices may be integrated into a system to produce opaqueholographic pixels.

In some embodiments, additional waveguide elements may be integratedcomprising energy inhibiting elements, beam-splitters, prisms, activeparallax barriers or polarization technologies in order to providespatial and/or angular resolutions greater than the diameter of thewaveguide or for other super-resolution purposes.

In some embodiments, the disclosed energy system may also be configuredas a wearable bi-directional device, such as virtual reality (VR) oraugmented reality (AR). In other embodiments, the energy system mayinclude adjustment optical element(s) that cause the displayed orreceived energy to be focused proximate to a determined plane in spacefor a viewer. In some embodiments, the waveguide array may beincorporated to holographic head-mounted-display. In other embodiments,the system may include multiple optical paths to allow for the viewer tosee both the energy system and a real-world environment (e.g.,transparent holographic display). In these instances, the system may bepresented as near field in addition to other methods.

In some embodiments, the transmission of data comprises encodingprocesses with selectable or variable compression ratios that receive anarbitrary dataset of information and metadata; analyze said dataset andreceive or assign material properties, vectors, surface IDs, new pixeldata forming a more sparse dataset, and wherein the received data maycomprise: 2D, stereoscopic, multi-view, metadata, light field,holographic, geometry, vectors or vectorized metadata, and anencoder/decoder may provide the ability to convert the data in real-timeor off-line comprising image processing for: 2D; 2D plus depth, metadataor other vectorized information; stereoscopic, stereoscopic plus depth,metadata or other vectorized information; multi-view; multi-view plusdepth, metadata or other vectorized information; holographic; or lightfield content; through depth estimation algorithms, with or withoutdepth metadata; and an inverse ray tracing methodology appropriatelymaps the resulting converted data produced by inverse ray tracing fromthe various 2D, stereoscopic, multi-view, volumetric, light field orholographic data into real world coordinates through a characterized 4Dplenoptic function. In these embodiments, the total data transmissiondesired may be multiple orders of magnitudes less transmittedinformation than the raw light field dataset.

Head Mounted Displays

In general, virtual reality (VR) and augmented reality (AR) devicesrequire very high resolution for standard stereoscopic viewing in orderto exceed the resolution limits of the eye and state of the art displayshave yet to produce sufficient resolution. Part of the challenge in adesign for VR and AR is the amount of data that would need to betransmitted to a headset, and the physical size and weight of higherresolution displays. An additional challenge for both technologiesinvolves the widest possible field of view (FOV) where most have lessthan 60 degrees of FOV per eye and may not be sufficient depending onthe applications involved.

When light field or holographic imaging is involved, the resolutionrequirements continue to increase by potentially multiple magnitudes.There are companies claiming to produce light fields for VR and ARdisplays, but at the time of this filing, those are believed to bestereoscopic displays with variable optics and associated processors andnot true light field or holographic imaging.

Disclosed embodiments can be leveraged to produce lightweight, widefield of view and extremely high-resolution 2D, stereoscopic and/orlight field VR or AR HMD's.

In the most simplistic implementation, a high-resolution seamless energysurface can be produced in combination with dioptric adjustment opticsto reimage the projected energy surface onto the viewer's natural planeof focus for traditional 2D or stereoscopic VR applications. The displaysize and resolution may be adjusted accordingly to map the FOV to exceedthe viewer's maximum periphery, and may be constructed with a densitythat meets and/or exceeds the resolution limits of the eye. The proposedimplementation may incorporate non-planar surfaces and other relayelements to produce seamless curved surfaces, decrease weight, increaseavailable view angles, or increase modulation transfer function (MTF) inaddition to multiple other potential applications. In this fashion, awrap-around monoscopic or stereoscopic energy surface may be produced asshown in FIG. 7.

FIG. 7 illustrates an embodiment of two displays with a concavecylindrical surface shape that exceed the FOV of the viewer and provideshigher resolution than possible with other contemporary technologies. Inan additional embodiment, rather than limiting the left and right eyeFOV with a barrier as is common in most displays today, a timesequential active and/or passive polarization system may be integratedto provide a singular contiguous curved display without the limitationof per eye FOV as shown in FIG. 9.

FIG. 8 illustrates a tapered energy relay mosaic 810 having two taperedenergy relays 830. In this embodiment, each energy relay element 830 isconfigured to propagate the energy from energy source 820 from the firstrelay surface 825 to the second common energy surface 850. In oneembodiment, the energy relay element 830 includes a flexible waveguideconfigured to provide magnified optics or minified optics. In anotherembodiment, the energy relay element 830 can be flat, curved, faceted,or non-uniform.

In some embodiments, randomized refractive index variability in thetransverse orientation coupled with minimal refractive index variationin the longitudinal orientation results in energy waves havingsubstantially higher transport efficiency along the longitudinalorientation, and spatial localization along the transverse orientationof energy relay 830. In other embodiments where the relay 830 isconstructed of multicore fiber, the energy waves propagating within eachrelay element may travel in the longitudinal orientation determined bythe alignment of fibers in this orientation.

Returning now to FIG. 7, one embodiment discloses a system having anenergy assembly 710 having a first energy device 720A and a secondenergy device 720B spaced from each other. The energy assembly 710includes a first tapered energy relay element 730A and a second taperedenergy relay element 730B spaced from each other. In one embodiment,energy emitted from the energy device 720A propagates from the firstsurface 725A to the curved second surface formed by the relay element730A. In another embodiment, energy emitted from the energy device 720Bpropagates from the first surface 725B to the curved second surfaceformed by the relay element 730B.

In one embodiment, each of the energy relay elements 730A, 730B hasrandomized refractive index variability in the transverse orientationcoupled with minimal refractive index variation in the longitudinalorientation, resulting in energy waves having substantially highertransport efficiency along the longitudinal orientation, and spatiallocalization along the transverse orientation. In other embodimentswhere the relays 730A and 730B are constructed of multicore fiber, theenergy waves propagating within each relay element may travel in thelongitudinal orientation determined by the alignment of fibers in thisorientation. In some embodiments, each of the energy relay elements730A, 730B includes a flexible waveguide configured to provide magnifiedoptics or minified optics. In another embodiment, each of the energyrelay elements 730A, 730B can be flat, curved, faceted, or non-uniform.

An energy combiner can be placed between each of the energy devices720A, 720B, and the first surface of its respective energy relay 725A,725B. In one embodiment, both energy devices are displays. In anotherembodiment, both energy devices are sensing devices. In a differentembodiment, one of the energy devices is a display, and the other is animaging sensor. These will be described in more detail below insubsequent figures and discussion.

In some embodiments, each of the systems disclosed in FIGS. 7 and 8 mayfurther include an additional waveguide element such as a lens tosubstantially change the direction of energy along an alternate energypropagation path. The additional waveguide element may be placed infront of the energy relay, disposed between the energy relay element andthe energy device, after the energy device, or anywhere throughout thesystem to substantially alter the direction of energy along an energypropagation path. In some embodiments, the additional waveguide elementincludes a dioptric adjustment optics that increases a field of viewalong the energy propagation path.

In some embodiments, it may be possible to split each energy surfacepath into two separate interlaced polarized paths with a relay elementimage combiner where the pixel density at the energy surface will resultin interlacing that may be difficult to detect with the eye due to therandom nature of the interlacing structure and the ability to nowdirectly polarize each display discreetly. The display itself may bepolarized with a film, coating, material, or the like and the opticalfibers maintain polarization states through to the energy surface. Thedioptric lens elements may then have passive polarization implementedsuch that each eye will only see a singular portion of the energysurface that is ultimately producing an extremely high resolution lefteye and right eye independent viewpoint without limiting the FOV in anyway. An additional benefit of this approach is not requiring timesequential stereoscopic imaging which may be known to cause temporalstereoscopic artifacts and require a much higher frequency display asnot to induce motion sickness when switching between alternatingviewpoints.

In other embodiments, the system further includes an energy combiningelement having first and second input surfaces, the first input surfacedisposed in the energy propagation path between the surface of theenergy relay element and the energy device, and the second input surfacedisposed in additional energy propagation path of an additional energysource. This will be described in more detail in subsequent discussion.

In one embodiment, the energy combining element is configured to combineenergy propagating through the first and second input surfaces andoutput the combined energy through an output surface of the energycombining element. In some embodiments, the energy combining element canbe a polarizing beam splitter, a prism or a dichoric film. In otherembodiments, the additional energy source includes at least a portion ofambient energy, energy from the at least one energy device, energy fromnon-energy devices, and energy outside of the system.

In one embodiment, a system may include first energy device and secondenergy device spaced from each other, where each of the first energydevice and the second energy device includes a first surface and asecond surface, respectively. In this embodiment, the system may furtherinclude first energy relay element and second energy relay elementspaced from each other, where each of the first energy relay element andthe second energy relay element includes a first surface and a secondsurface, respectively. The first energy device may be coupled to thefirst energy relay element, and the second energy device may be coupledto the second energy relay element. In operation, the first energy relayelement is configured to propagate energy between the first surface ofthe first energy device and the second surface of the first relayelement, and the second energy relay element is configured to propagatethe energy between the first surface of the second energy device and thesecond surface of the second relay element.

In another embodiment, each of the first energy relay element and thesecond energy relay element includes a flexible waveguide configured toprovide magnified optics or minified optics. In some embodiments, eachof the first energy relay element and the second energy relay element iscomposed of two or more energy relays in series, including taperedoptical relays with spatial magnification, tapered optical relays withspatial de-magnification, coherent optical relays, flexible opticalrelays, and faceplates. In other embodiments, the first surfaces and thesecond surfaces of the first energy relay element and the second energyrelay elements can be flat, curved, faceted, or non-uniform.

In one embodiment, the system further includes additional waveguideelements in front of each of the second surface of the first energyrelay element and the second surface of the second energy relay, each ofthe additional waveguide elements configured to substantially alter thedirection of energy along an alternate energy path. In theseembodiments, the additional waveguide elements include dioptricadjustment optics that increases a field of view of the energy along theenergy propagation path.

In one embodiment, the first energy device may be coupled to the firstrelay through a first energy combining element, and the second energydevice may be coupled to the second relay through a second energycombining element. In some embodiments, each of the first energycombining element and the second energy combining element can be apolarizing beam splitter, a prism or a dichoric film.

In one embodiment, the system further includes a first display devicedisposed on the first energy combining element and a second displaydevice disposed on the second energy combining element. In anotherembodiment, the system further includes a first sensor disposed on thefirst energy combining element and a second sensor disposed on thesecond energy combining element. In one embodiment, the first energycombining element is configured to combine the energy from the firstenergy device and energy from an additional source external to thesystem. In another embodiment, the second energy combining element isconfigured to combine the energy from the second energy device andenergy from an additional source external to the system.

FIG. 9 illustrates a system having an energy assembly 910 having aplurality of energy devices 920 and relay elements 930. In operation,this design leverages a curved semi-spherical surface, producingdiscreetly generated and directly polarized stereoscopic views fromwithin the same pixel structure.

In one embodiment, the system includes one or more energy devices 920A,920B, 920C, 920D, 920E and one or more energy relay elements 930A, 930B,930C, 930D, 930E. Each of the energy relay elements 930A-930E includes afirst surface 932A, 932B, 932C, 932D, 932E and a second surface 934A,934B, 934C, 934D, 934E, where the first surface 932A-932E is disposed inenergy propagation paths of the one or more energy devices 920A-920E.

The second surface 934A-934E of each of the one or more energy relayelements 930A-930E may be arranged to form a singular seamless energysurface 990. In some embodiments, the singular seamless energy surfacemay be a curved and polished faceplate. In this embodiment, a separationbetween edges of any two adjacent second surfaces (e.g., 934A and 934B,934C and 934D) may be less than a minimum perceptible contour as definedby the visual acuity of a human eye having better than 20/40 vision at adistance from the singular seamless energy surface 990, the distancebeing greater than the lesser of: half of a height of the singularseamless energy surface 990, or half of a width of the singular seamlessenergy surface 990.

In this embodiment, a first aperture 980A has a first field of view onthe singular seamless energy surface 990, and a second aperture 980B hasa second field of view on the singular seamless energy surface 990, thefirst and second fields of view overlapping in a first region A. In someembodiments, the system may further include energy inhibiting elements975A, 975B, 975C, 975D, 975E configured to substantially allow energy topropagate through only one of the first and second apertures 980A, 980B.The energy inhibiting element 975A-975E may include filters, blockersand polarized film, configured to allow different encoding states (+ or−) to pass therethrough. In operation, the energy inhibiting element975A-975E may further limit propagation of the energy based on differentencoding of the energy at different locations, and allowing only one ofdifferent encoding states (e.g., + or −, R/G/B) to pass therethrough.

In some embodiments, each of the one or more energy relay elements930A-930E includes a flexible waveguide configured to provide magnifiedoptics or minified optics. In other embodiments, each of the secondsurfaces 934A-934E of the one or more energy relay elements 930A-930Ecan be flat, curved, faceted, or non-uniform.

An energy combiner 940A-940E can be bonded to the minified end of eachtapered energy relay 930A-930E at surfaces 932A-932E, respectively. Inone embodiment, the energy devices 975A-975E on the leg of the imagecombiner labeled ‘−’ can be displays, while the energy devices 920A-920Eon the other leg labeled ‘+’ can also be displays. In anotherembodiment, all the energy devices on both ‘−’ and ‘+’ legs of thecombiners can be energy sensors. In yet another embodiment, the energydevices on leg ‘−’ of the image combiners can be displays, and theenergy devices on leg ‘+’ are energy sensing devices.

In one embodiment, the system further includes additional waveguideelements 960A, 960B configured to substantially alter the direction ofenergy to propagate through the first and second apertures 980A, 980B,respectively. Although two additional waveguide elements 960A, 960B areshown, it will be appreciated by one skilled in the art that there needonly be one additional waveguide element 960 for altering the directionof energy through the apertures 980. In some embodiments, the additionalwaveguide element 960 includes a dioptric adjustment optics thatincreases the first FOV, the second FOV, or both the first and secondFOV's.

In some embodiments, one may introduce a beam splitter, prism,reflectors or the like in order to produce a high resolution, wide FOVAR experience where the optical path to view the world may be split withan optical device to allow the ability to map and overlay graphics orother content onto the environment without limitation of FOV orresolution. In similar manner, it may be possible to produce a planar,cylindrical, or spherical image surface, with or without image combiningand direct polarization to increase the available FOV per eye oraperture, aligned to the optical path that the eye sees, providingextraordinary resolution and FOV as reflected and mapped onto the realworld environment. It may be possible to maintain light weight opticsleveraging plastic materials or elements exhibiting AndersonLocalization phenomena, as well as maintain a small energy surface sizeby directly minifying the entirety of the display with loose coherentfibers and image conduits and the like.

In an exemplary version of a HMD system concept, the optical path may beshared between the external environment and a high-resolution, wide FOVdisplay. FIG. 10 shows one such embodiment of a HMD system 1010, wherethe display includes one or more energy device 1020, connected to one ormore energy combiner elements 1040, connected to relay elements 1030,and configured to form a single seamless energy surface 1090 arranged ina perpendicular orientation to be viewable by the reflection in the beamsplitter.

In one embodiment, the HMD system 1010 further includes an energycombining element 1060 having first and second input surfaces, the firstinput surface disposed in energy propagation paths of the singleseamless energy surface 1090 and the second input surface disposed inenergy propagation paths of additional energy sources 1085.

In some embodiments, the system may include prisms, reflectors,beam-splitters or the like where the reflector/prism may be disposed ata 45-degree angle to the left for the left eye and the right for theright eye, allowing a simplification to the entire design withoutrequiring polarization or image combiners, so that each eye may betreated independently, eliminating overlap between left and right eyefields of view and helping reduce the overall form factor of the design.

In operation, the energy combining element 1060 is capable of combiningenergy propagating through the first and second input surfaces andoutput the combined energy through an output surface of the energycombining element 1060. In some embodiments, the energy combiningelement 1060 can be a polarizing beam splitter, a prism, or a dichoricfilm. The beam splitter is able to split optical paths at the eye intotwo or more paths such that a user can view the unobstructed real-worldobject and an image from the system simultaneously. In these instances,the user may be viewing different optical split percentages between thereal-world and the system (e.g., 50/50, 25/75, or variable). Theadditional energy source 1085 may include at least one of a portion ofambient energy, energy from the one or more energy devices 1020, energyfrom non-energy devices, or energy outside of the system 1010.

Like above, each of the one or more energy relay elements of FIGS. 7-10may be fabricated with randomized refractive index variability in thetransverse orientation coupled with minimal refractive index variationin the longitudinal orientation, resulting in energy waves havingsubstantially higher transport efficiency along the longitudinalorientation, and spatial localization along the transverse orientation.In other embodiments where the relay is constructed of multicore fiber,the energy waves propagating within each relay element may travel in thelongitudinal orientation determined by the alignment of fibers in thisorientation.

FIG. 11 illustrates an embodiment of a HMD system 1110 with a highresolution display mounted to the left and right sides of the device,for the left and right eye, respectively. In one embodiment, the devices1160A, 1160B are reflectors. The device contains one or more energydevices 1120A, 1120B, and one or more energy relay elements 1130A,1130B. Each of the energy relay elements 1130A, 1130B includes a firstsurface 1132A, 1132B and a second surface 1134A, 1134B where the firstsurface 1132A, 1132B is disposed in energy propagation paths of the oneor more energy devices 1120A, 1120B and the second surface 1134A, 1134Bof each of the one or more energy relay elements 1130A, 1130B isarranged to form a singular seamless energy surface (not shown in FIG.11 but similar to that of FIG. 9 as can be appreciated by one of skillin the art). Like above, in this embodiment, a separation between edgesof any two adjacent second surfaces can be less than a minimumperceptible contour as defined by the visual acuity of a human eyehaving better than 20/40 vision at a distance from the singular seamlessenergy surface, the distance being greater than the lesser of: half of aheight of the singular seamless energy surface, or half of a width ofthe singular seamless energy surface.

In this embodiment, a first aperture 1180A has a first FOV and thesecond aperture 1180B has a second field of view, the first and secondfields of view overlapping in a first region. In one embodiment, thesystem 1110 further includes an energy inhibiting element (not shown)configured to substantially allow energy to propagate through only oneof the first and second apertures 1180. In another embodiment, thesystem 1110 further includes an energy combining element 1160 havingfirst and second input surfaces, the first input surface disposed in theenergy propagation paths of the single seamless energy surface and thesecond input surface disposed in energy propagation paths of anadditional energy source.

In an embodiment, a waveguide element such as a lens array may beintroduced in front of each tapered energy relay in order to render acomplete light field in a VR or AR headset. This requires N² higherresolution that may be potentially challenging depending on the marketand application. Given the increased data and resolution requirements,leveraging loose coherent optical fibers and minification of the imagemay be advantageous to optically relay the physical electronics off ofthe headset and into an accessory device. By leveraging the concept ofminifying the energy surface in relation to the pixel size, it may bepossible to, provide a first optical fiber taper to minify the display,couple the minified end to a loose coherent fiber with minificationratio 1, couple the alternate end of the loose coherent fiber to theminified end of an optical fiber taper and produce the energy surfacewith the magnified end with magnification ratio 2 which should be lessthan the effective inverse minification from ratio 1 in order tomaintain a smaller overall energy surface. The loose coherent fibers maybe in excess of a meter in length and can be aggregated together to forma singular optical tether to the accessory electronics.

FIG. 12 illustrates the addition of a waveguide array into thepreviously described embodiment where there is a left eye energysurface, and a right eye energy surface, and a right eye reflector andenergy surface 1260B and each energy surface is attached to a loosecoherent fiber that is offset into an accessory electronics device thatcontains the additional optical fibers and display components. Thisimplementation can also be leveraged with or without the waveguidearray, and for VR or AR to help achieve a more lightweight and pragmaticHMD design.

In one embodiment, the HMD system 1210 includes one or more energydevices 1220A, 1220B, one or more energy relay elements 1230A, 1230B,each having a first surface and a second surface where the first surfaceis disposed in energy propagation paths of the one or more energydevices 1220A, 1220B similar to those discussed above. In thisembodiment, energy may be relayed from the energy devices 1220 to theenergy relay elements 1230 via loose coherent optical fibers therebyminimizing the form factor of the HMD design and hardware.

Returning now to FIG. 12, the HMD system 1210 further includes thesecond surface of each of the one or more energy relay elements 1230arranged to form a singular seamless energy surface, where a separationbetween edges of any two adjacent second surfaces is less than a minimumperceptible contour as defined by the visual acuity of a human eyehaving better than 20/40 vision at a distance from the singular seamlessenergy surface, the distance being greater than the lesser of: half of aheight of the singular seamless energy surface, or half of a width ofthe singular seamless energy surface similar to that discussed above.

In operation, a first aperture 1280A has a first field of view on acorresponding singular seamless energy surface, and a second aperture1280B has a second field of view on a corresponding singular seamlessenergy surface, the first and second fields of view overlapping. Thesystem 1210 further includes an energy inhibiting element (not shown)configured to substantially allow energy to propagate through only oneof the first and second apertures 1280. In some embodiments, the system1210 includes energy combining elements 1260A and 1260B having first andsecond input surfaces, the first input surface disposed in the energypropagation paths of a single seamless energy surface and the secondinput surface disposed in energy propagation paths of an additionalenergy source.

In some embodiments, each of the one or more energy relay elements 1230of the HMD system 1210 includes a flexible waveguide configured toprovide magnified optics or minified optics. In other embodiments, eachof the second surfaces of the one or more energy relay elements 1230 canbe flat, curved, faceted, or non-uniform. In yet other embodiments, anenergy combiner can be placed at the magnified end of each one of thetapered relays 1220A and 1220B, so that two energy devices can beattached (not shown in FIG. 12 but best illustrated in FIG. 9 as can beappreciated by one of skill in the art). For each combiner, both theenergy devices can be displays, or both can be energy sensing devices,or one could be a display while the second could be an energy sensingdevice.

In one embodiment, the system 1210 further includes an additionalwaveguide element 1250A, 1250B configured to substantially alter thedirection of energy to propagate through the first aperture 1280A, thesecond aperture 1280B, or both the first and second apertures 1280. Inthese instances, the additional waveguide element includes a dioptricadjustment optics that increases the first field of view, the secondfield of view, or both the first and second fields of view.

In one embodiment, each of the one or more energy relay elements 1220and 1230 may be fabricated with randomized refractive index variabilityin the transverse orientation coupled with minimal refractive indexvariation in the longitudinal orientation, resulting in energy waveshaving substantially higher transport efficiency along the longitudinalorientation, and spatial localization along the transverse orientation.In other embodiments where the relay is constructed of multicore fiber,the energy waves propagating within each relay element may travel in thelongitudinal orientation determined by the alignment of fibers in thisorientation.

In one embodiment, the HMD system 1210 may further include an energymodulation element 1250A, 1250B disposed between the energy combiningelement and the single seamless energy surface, the energy modulationelement 1250 configured to modulate energy passing therethrough.

In some embodiments, the HMD systems disclosed herein further includesan array of energy waveguides configured to direct energy therethroughalong the energy propagation paths, where the energy waveguides of thearray are located at different spatial coordinates, and each energywaveguide directs energy from the respective spatial coordinate to theenergy propagation paths along different directions according to a 4Dplenoptic function.

While various embodiments in accordance with the principles disclosedherein have been described above, it should be understood that they havebeen presented by way of example only, and are not limiting. Thus, thebreadth and scope of the invention(s) should not be limited by any ofthe above-described exemplary embodiments, but should be defined only inaccordance with the claims and their equivalents issuing from thisdisclosure. Furthermore, the above advantages and features are providedin described embodiments, but shall not limit the application of suchissued claims to processes and structures accomplishing any or all ofthe above advantages.

It will be understood that the principal features of this disclosure canbe employed in various embodiments without departing from the scope ofthe disclosure. Those skilled in the art will recognize, or be able toascertain using no more than routine experimentation, numerousequivalents to the specific procedures described herein. Suchequivalents are considered to be within the scope of this disclosure andare covered by the claims.

Additionally, the section headings herein are provided for consistencywith the suggestions under 37 CFR 1.77 or otherwise to provideorganizational cues. These headings shall not limit or characterize theinvention(s) set out in any claims that may issue from this disclosure.Specifically, and by way of example, although the headings refer to a“Field of Invention,” such claims should not be limited by the languageunder this heading to describe the so-called technical field. Further, adescription of technology in the “Background of the Invention” sectionis not to be construed as an admission that technology is prior art toany invention(s) in this disclosure. Neither is the “Summary” to beconsidered a characterization of the invention(s) set forth in issuedclaims. Furthermore, any reference in this disclosure to “invention” inthe singular should not be used to argue that there is only a singlepoint of novelty in this disclosure. Multiple inventions may be setforth according to the limitations of the multiple claims issuing fromthis disclosure, and such claims accordingly define the invention(s),and their equivalents, that are protected thereby. In all instances, thescope of such claims shall be considered on their own merits in light ofthis disclosure, but should not be constrained by the headings set forthherein.

The use of the word “a” or “an” when used in conjunction with the term“comprising” in the claims and/or the specification may mean “one,” butit is also consistent with the meaning of “one or more,” “at least one,”and “one or more than one.” The use of the term “or” in the claims isused to mean “and/or” unless explicitly indicated to refer toalternatives only or the alternatives are mutually exclusive, althoughthe disclosure supports a definition that refers to only alternativesand “and/or.” Throughout this application, the term “about” is used toindicate that a value includes the inherent variation of error for thedevice, the method being employed to determine the value, or thevariation that exists among the study subjects. In general, but subjectto the preceding discussion, a numerical value herein that is modifiedby a word of approximation such as “about” may vary from the statedvalue by at least ±1, 2, 3, 4, 5, 6, 7, 10, 12 or 15%.

As used in this specification and claim(s), the words “comprising” (andany form of comprising, such as “comprise” and “comprises”), “having”(and any form of having, such as “have” and “has”), “including” (and anyform of including, such as “includes” and “include”) or “containing”(and any form of containing, such as “contains” and “contain”) areinclusive or open-ended and do not exclude additional, unrecitedelements or method steps.

Words of comparison, measurement, and timing such as “at the time,”“equivalent,” “during,” “complete,” and the like should be understood tomean “substantially at the time,” “substantially equivalent,”“substantially during,” “substantially complete,” etc., where“substantially” means that such comparisons, measurements, and timingsare practicable to accomplish the implicitly or expressly stated desiredresult. Words relating to relative position of elements such as “near,”“proximate to,” and “adjacent to” shall mean sufficiently close to havea material effect upon the respective system element interactions. Otherwords of approximation similarly refer to a condition that when somodified is understood to not necessarily be absolute or perfect butwould be considered close enough to those of ordinary skill in the artto warrant designating the condition as being present. The extent towhich the description may vary will depend on how great a change can beinstituted and still have one of ordinary skilled in the art recognizethe modified feature as still having the required characteristics andcapabilities of the unmodified feature.

The term “or combinations thereof” as used herein refers to allpermutations and combinations of the listed items preceding the term.For example, A, B, C, or combinations thereof is intended to include atleast one of: A, B, C, AB, AC, BC, or ABC, and if order is important ina particular context, also BA, CA, CB, CBA, BCA, ACB, BAC, or CAB.Continuing with this example, expressly included are combinations thatcontain repeats of one or more item or term, such as BB, AAA, AB, BBC,AAABCCCC, CBBAAA, CABABB, and so forth. The skilled artisan willunderstand that typically there is no limit on the number of items orterms in any combination, unless otherwise apparent from the context.

All of the compositions and/or methods disclosed and claimed herein canbe made and executed without undue experimentation in light of thepresent disclosure. While the compositions and methods of thisdisclosure have been described in terms of preferred embodiments, itwill be apparent to those of skill in the art that variations may beapplied to the compositions and/or methods and in the steps or in thesequence of steps of the method described herein without departing fromthe concept, spirit and scope of the disclosure. All such similarsubstitutes and modifications apparent to those skilled in the art aredeemed to be within the spirit, scope and concept of the disclosure asdefined by the appended claims.

1. A system comprising: an energy assembly having at least one energydevice; and a relay assembly having: at least one energy relay element,the energy relay element formed of one or more of a first componentengineered structure and one of a second component engineered structure,the first component engineered structure having a first wave propagationproperty and the second component engineered structure having a secondwave propagation property; wherein, along a transverse orientation thefirst component engineered structure and the second component engineeredstructure are arranged in an interleaving configuration; wherein, alonga longitudinal orientation the first component engineered structure andthe second component engineered structure each have a similarconfiguration; wherein the relay element relays energy along thelongitudinal orientation through both the first component engineeredstructure and second component engineered structure, the energy beingrelayed is spatially localized in the transverse orientation; whereinthe first component engineered structure is aligned such that energy ispropagated through the first component engineered structure with ahigher transport efficiency in the longitudinal orientation versus thetransverse orientation; and wherein the second component engineeredstructure is aligned such that energy is propagated through the secondcomponent engineered structure with a higher transport efficiency in thelongitudinal orientation versus the transverse orientation; and whereinthe energy relay element is configured to direct energy along energypropagation paths between a surface of the energy relay element and theenergy device.
 2. The system of claim 1, wherein the energy relayelement includes a flexible waveguide configured to provide magnifiedoptics or minified optics.
 3. The system of claim 1, wherein the energyrelay element can be flat, curved, faceted, or non-uniform.
 4. Thesystem of claim 1, wherein: the energy assembly includes a first energydevice and a second energy device spaced from each other, the relayassembly includes a first energy relay element and a second energy relayelement spaced from each other, wherein the first energy relay elementis configured to direct energy along a first energy propagation pathbetween a first surface of the first energy relay element and the firstenergy device, and wherein the second energy relay element is configuredto direct energy along a second energy propagation path between a firstsurface of the second energy relay element and the second energy device.5. The system of claim 4, wherein both of the first energy device andthe second energy device include displays, and wherein the systemfurther comprises an energy combining element configured to relay energybetween the first surface of the first energy relay element and thefirst energy device, and the first surface of the second energy relayelement and the second energy device.
 6. The system of claim 4, whereinboth of the first energy device and the second energy device includeenergy sensing devices, and wherein the system further comprises anenergy combining element configured to relay energy between the firstsurface of the first energy relay element and the first energy device,and the first surface of the second energy relay element and the secondenergy device.
 7. The system of claim 4, wherein the first energy deviceincludes a display and the second energy device includes an energysensing device, and wherein the system further comprises an energycombining element configured to relay energy between the first surfaceof the first energy relay element and the first energy device, and thefirst surface of the second energy relay element and the second energydevice.
 8. The system of claim 1, further comprising an additionalwaveguide element configured to substantially alter the direction ofenergy along an alternate energy propagation path.
 9. The system ofclaim 8, wherein the additional waveguide element includes a dioptricadjustment optics that increases a field of view of the energy along theenergy propagation path.
 10. The system of claim 1, further comprisingan energy combining element having first and second input surfaces, thefirst input surface disposed in the energy propagation path between thesurface of the energy relay element and the energy device, and thesecond input surface disposed in additional energy propagation path ofan additional energy source.
 11. The system of claim 10, wherein theenergy combining element is configured to combine energy propagatingthrough the first and second input surfaces and output the combinedenergy through an output surface of the energy combining element. 12.The system of claim 10, wherein the energy combining element can be apolarizing beam splitter, a prism or a dichoric film.
 13. The system ofclaim 10, wherein the additional energy source includes at least aportion of ambient energy, energy from the at least one energy device,energy from non-energy devices, and energy outside of the system.
 14. Asystem comprising: one or more energy devices; one or more energy relayelements, each having a first surface and a second surface, wherein thefirst surface is disposed in energy propagation paths of the one or moreenergy devices; wherein distances that separate any two adjacent firstsurfaces of the respective energy relay elements from each other areless than distances that separate any two adjacent second surfaces ofthe respective energy relay elements from each other; wherein the secondsurfaces of the one or more energy relay elements is arranged to form asingular seamless energy surface; and wherein a first aperture has afirst field of view on the singular seamless energy surface, and asecond aperture has a second field of view on the singular seamlessenergy surface, the first and second fields of view overlapping in afirst region.
 15. The system of claim 14, wherein the singular seamlessenergy surface prevents a separation between adjacent second surfaces ofthe respective energy relay elements from being seen.
 16. The system ofclaim 14, further comprising an energy inhibiting element configured tosubstantially allow energy to propagate through only one of the firstand second apertures.
 17. The system of claim 14, wherein each of theone or more energy relay elements includes a flexible waveguideconfigured to provide magnified optics or minified optics.
 18. Thesystem of claim 14, wherein each of the second surfaces of the one ormore energy relay elements can be flat, curved, faceted, or non-uniform.19. The system of claim 14, wherein the one or more energy devicesinclude a first energy device and a second energy device, wherein bothof the first energy device and the second energy device includedisplays, and wherein the system further comprises an energy combiningelement configured to relay energy between each of the first energydevice and the second energy device, and the first surface of the energyrelay element.
 20. The system of claim 14, wherein the one or moreenergy devices include a first energy device and a second energy device,wherein both of the first energy device and the second energy deviceinclude energy sensing devices, and wherein the system further comprisesan energy combining element configured to relay energy between each ofthe first energy device and the second energy device, and the firstsurface of the energy relay element. 21.-27. (canceled)